Electronic apparatus and method

ABSTRACT

According to one embodiment, a method executed by an electronic apparatus including storage configured to store device information including first position information indicating a position of a device installed in a particular range and risk information associated with use of the device is provided. The method includes receiving second position information indicating a position of a user wearing an eyeglasses-type wearable terminal and working within the particular range, from the eyeglasses-type wearable terminal and estimating a status of the user, based at least in part on the first position information and the risk information included in the device information, and the second position information.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.14/968,759, filed Dec. 14, 2015, which is based upon and claims thebenefit of priority from Japanese Patent Application No. 2015-171932,filed Sep. 1, 2015, the entire contents of which are incorporated hereinby reference.

FIELD

Embodiments described herein relate generally to an electronic apparatusand a method.

BACKGROUND

Recently, for example, a wearable terminal worn and used by a user hasbeen put into practice. As the wearable terminal, for example, aneyeglasses-type wearable terminal, a wristband-type wearable terminal,etc. are known.

Since this wearable terminal can be used in a hands-free state, forexample, attachment of a user (hereinafter called a worker) workingwithin a particular range such as a factory has been reviewed.

Incidentally, a manager who manages workers is positioned in the factorywhere the workers work. The manager gives workers instructions forassignment of works, confirmation and change of works, etc., but, forexample, if the factory area is large and the number of workers isgreat, the instructions are often given by call (speech communication).

For example, however, if a worker in a dangerous status (for example,working at a high position) receives a call (incoming call) from themanager, the worker willing to respond to the call may often losebalance unintentionally and may be involved in an unexpected accident.Furthermore, in such a case, the worker frequently cannot respond to thecall from the manager, and this is considered inefficient. A system ofrecognizing the worker's status is therefore desired.

BRIEF DESCRIPTION OF THE DRAWINGS

A general architecture that implements the various features of theembodiments will now be described with reference to the drawings. Thedrawings and the associated descriptions are provided to illustrate theembodiments and not to limit the scope of the invention.

FIG. 1 is an illustration for explanation of an example of anenvironment using a management system of a first embodiment.

FIG. 2 is a schematic illustration showing an example of a workerterminal worn and used by a worker.

FIG. 3 is a schematic illustration showing an example of the workerterminal worn and used by a worker.

FIG. 4 is a diagram showing an example of a network configuration of amanagement system.

FIG. 5 is a diagram showing an example of a system configuration of theworker terminal.

FIG. 6 is a diagram showing an example of a system configuration of themanager terminal.

FIG. 7 is a block diagram showing an example of a functionalconfiguration of a management server.

FIG. 8 is a table showing an example of a data structure of workerinformation stored in worker information storage.

FIG. 9 is a table showing an example of a data structure of deviceinformation stored in device information storage.

FIG. 10 is a table showing an example of a data structure of processinformation stored in process information storage.

FIG. 11 is an illustration for explanation of summary of statusestimation processing.

FIG. 12 is an illustration for explanation of summary of the statusestimation processing.

FIG. 13 is a flowchart showing a processing procedure of the statusestimation processing.

FIG. 14 is a flowchart showing a processing procedure of a managementserver outputting a notification to the worker terminal and the managerterminal.

FIG. 15 is an illustration for explanation of an example of a displayarea of the worker terminal.

FIG. 16 is a table showing an example of a data structure of deviceinformation stored in device information storage of a second embodiment.

FIG. 17 is a flowchart showing a processing procedure of statusestimation processing.

FIG. 18 is a diagram showing an example of a system configuration of aworker terminal of a third embodiment.

FIG. 19 is a flowchart showing a processing procedure of statusestimation processing.

DETAILED DESCRIPTION

Various embodiments will be described hereinafter with reference to theaccompanying drawings.

In general, according to one embodiment, a method executed by anelectronic apparatus including storage configured to store deviceinformation including first position information indicating a positionof a device installed in a particular range and risk informationassociated with use of the device is provided. The method includesreceiving second position information indicating a position of a userwearing an eyeglasses-type wearable terminal and working within theparticular range, from the eyeglasses-type wearable terminal andestimating a status of the user, based at least in part on the firstposition information and the risk information included in the deviceinformation, and the second position information.

First Embodiment

A first embodiment will be described. FIG. 1 is an illustration forexplanation of an example of an environment in which a management systemincluding a management server of the present embodiment is used.

The management system of the embodiment is used to manage, for example,a worker working within a particular range (for example, a factory site)and a device (for example, a manufacturing device for manufacturing aproduct) installed in the range.

As shown in FIG. 1, the management system includes a worker terminal 10,a manufacturing device 20, a manager terminal 30 and a management server40.

The worker terminal 10 is, for example, a terminal device (userterminal) used by a worker (user) working within a work area 100 such asa factory site. The worker terminal 10 implies, for example, aneyeglasses-type wearable terminal which the worker can wear and use. Theworker terminal 10 is hereinafter explained as an eyeglasses-typewearable terminal.

As shown in FIG. 1, a worker wears and uses one worker terminal 10. Forthis reason, the management system includes the number of workerterminals 10 corresponding to the number of workers.

The manufacturing device 20 is, for example, a device capable ofmanufacturing a product by a worker operation. The manufacturing device20 is assumed to be, for example, a device which automaticallymanufactures a product by allowing the worker to set members necessaryfor the manufacturing and complete the preparation. In the presentembodiment, the management system includes the manufacturing device 20,but may include, for example, any other devices installed in the workarea 100.

One manufacturing device 20 is shown in FIG. 1 for convenience, but aplurality of manufacturing devices 20 are assumed to be installed in thework area 100.

The manager terminal 30 is a terminal device used by a manager whomanages the worker and the manufacturing device 20 in the work area 100.The manager terminal 30 implies, for example, a personal computer, etc.,installed in a monitoring chamber, etc., outside the work area 100. Forexample, if the manager walks around in the work area 100 to monitor theworker's working condition, the operation condition of the manufacturingdevice 20, etc., the eyeglasses-type wearable terminal similar to theworker terminal 10 may be used as the manager terminal 30.

The management server 40 is a server device (electronic apparatus) whichmanages a product manufacturing process executed by the manufacturingdevice 20 installed in the work area 100. The management server 40 has afunction of estimating the status of the worker working within the workarea 100, and details of the function will be explained later.

A plurality of access points are assumed to be provided in the work area100 to allow the worker terminal 10 to execute wireless communication,but are not shown in FIG. 1.

Each of FIG. 2 and FIG. 3 is a schematic illustration showing an exampleof the worker terminal (eyeglasses-type wearable terminal) worn and usedby the worker.

The worker terminal 10 comprises a light projection unit 1001, alens-integrated screen (display) 1002, etc.

The light projection unit 1001 includes a light source module 1001 a, anadditional image display module 1001 b, a half-mirror module 1001 c, alens group 1001 d, a driver 1001 e, a built-in power supply 1001 f, etc.In the light projection unit 1001, an image and information displayed bythe additional image display module 1001 b are illuminated with light2000 emitted from the light source module 1001 a, and its reflectedlight (projected image) is output (emitted). The light 2000 emitted fromthe light source module 1001 a is non-parallel light having divergence(divergent light).

The light source module 1001 a should preferably be a dimming-type whiteLED light source including a plurality of, for example, three lightemitting diodes (LED) in which their output light quantities can bevaried independently. In this case, three LEDs are assumed to bedifferent in light color. If such a dimming-type white LED light sourceis used, a display color which can easily be seen to the worker can beprovided (output) by changing the light color in accordance with theenvironment of use that the worker terminal 10 is used in a clean roomin which illumination mainly based on, for example, an orange color isoften used.

The additional image display module 1001 b is, for example, areflection-type liquid crystal display (LCD) module and displays apredetermined additional image. The predetermined additional imageincludes, for example, various messages, marks, etc.

The light 2000 emitted from the light source module 1001 a is reflectedon the half-mirror module 1001 c to illuminate the additional imagedisplayed on the additional image display module 1001 b, and isreflected again as image light corresponding to the additional image.

The light (additional image light) 2000 reflected at the additionalimage display module 1001 b passes through the half-mirror module 1001c, is given a predetermined image size by the lens group 1001 d, andreaches the lens-integrated screen 1002.

The driver 1001 e controls the light emitted from the light sourcemodule 1001 a in response to the additional image displayed on theadditional image display module 1001 b.

The built-in power supply 1001 f is implemented by, for example, abutton battery or the like. The worker terminal 10 operates with thepower supplied from the built-in power supply 1001 f.

The lens-integrated screen 1002 includes a Fresnel lens type half-mirrorportion 1002 a.

The light 2000 reaching the lens-integrated screen 1002 as explainedabove is reflected in part on the Fresnel lens type half-mirror portion1002 a to form a virtual image corresponding to the additional imagedisplayed on the additional image display module 1001 b.

As shown in FIG. 3, the worker terminal 10 includes a speaker 1001 g, a(slide) switch 1001 h, a (rotary) knob 1001 i, etc., at a predeterminedposition (for example, a bottom surface portion) of the light projectionunit 1001. The switch 1001 h is provided to adjust, for example,luminance of the light 2000 emitted from the light projection unit 1001.The knob 1001 i is provided to adjust, for example, an angle ofprojection of the light 2000 emitted from the light projection unit1001. By operating each of the switch 1001 h and the knob 1001 i, theworker (user of the eyeglasses-type wearable terminal) can adjust theluminance and the angle of projection while visually recognizing theadditional image projected by the lens-integrated screen 1002. In otherwords, display luminance and color tone of the additional image suitablefor the worker's taste can be provided by providing the switch 1001 h.In addition, the additional image can be displayed at an optimumposition in accordance with the shape and size of the head of theworker, by providing the knob 1001 i.

Furthermore, a camera 1003 for taking an image of, for example, aperiphery of the worker terminal 10 is provided on the worker terminal10. The camera 1003, which is provided at, for example, a position shownin FIG. 3, takes an image in a direction of the line of sight of theworker wearing the worker terminal 10.

FIG. 4 shows a network configuration of the management system. Anexample in which the management system includes a plurality of workerterminals 10 is illustrated in FIG. 4. In FIG. 4, the plurality ofworker terminals 10 include worker terminals 10-1, 10-2, . . . , 10-n(where n is an integer greater than or equal to, for example, three).

As shown in FIG. 4, the plurality of worker terminals 10 are connectedto the management server 40 via a network NTW so as to enablecommunication, in the management system of the present embodiment. Themanagement server 40 can thereby receive (acquire) various types ofinformation to be explained later from the plurality of worker terminals10.

The management server 40 and each of the manufacturing devices 20 may beconnected via the network NTW so as to enable communication, but theconnection is not shown in FIG. 4. In such a configuration, themanagement server 40 can receive (collect) information indicating eachstatus of the manufacturing device 20 (hereinafter called statusinformation of the manufacturing device 20) from the manufacturingdevice 20. Statuses indicated by the status information include, forexample, a status in which a product is being manufactured, a status inwhich preparation for manufacturing the product is completed, a statusin which the preparation for manufacturing the product is not completed,etc. The status information may include information as to whether themanufacturing device 20 is operated or not, etc.

FIG. 5 shows an example of a system configuration of the worker terminal10. As shown in FIG. 5, the worker terminal 10 includes a CPU 11, a ROM12, a RAM 13, a global positioning system (GPS) sensor 14, anacceleration sensor 15, a barometric pressure sensor 16, a communicationmodule 17, etc. The components explained with reference to FIG. 2, FIG.3, etc., are not shown in FIG. 5.

The CPU 11 is a hardware processor (processing circuit) which controlsoperations of the components in the worker terminal 10. The CPU 11executes various types of software (programs for the worker terminal 10)loaded from the ROM 12 which is a nonvolatile memory on the RAM (mainmemory) 13.

The GPS sensor 14 is a sensor capable of detecting a position of (aworker wearing) the worker terminal 10 by executing communication with aGPS satellite.

The acceleration sensor 15 is a sensor capable of measuring theacceleration generated on (the worker wearing) the worker terminal 10.

The barometric pressure sensor 16 is a sensor capable of measuring abarometric pressure on the periphery of the worker terminal 10. Theworker terminal 10 can estimate a position in a vertical direction ofthe worker wearing the worker terminal 10, based on (variation in) thebarometric pressure measured by the barometric pressure sensor 16, andobtain information indicating the estimated position in a verticaldirection of the worker.

The communication module 17 is a module which executes wirelesscommunication with the management server 40, etc., via the network NTW.The communication module 17 executes wireless communication such aswireless LAN via, for example, an access point provided in the work area100.

The communication module 17 can thereby transmit to the managementserver 40 information indicating the position detected by the GPS sensor14 (hereinafter called position information of the worker), informationindicating the acceleration measured by the acceleration sensor 15(hereinafter called acceleration information of the worker), and theabove-explained information obtained based on the barometric pressuremeasured by the barometric pressure sensor 16 (hereinafter called heightinformation of the worker).

The communication module 17 may execute wireless communicationconforming to standards such as Wi-Fi (registered trademark), WiMAX(registered trademark), 3G mobile communication, 4G mobilecommunication, and Bluetooth (registered trademark).

The worker terminal 10 further includes a microphone, etc., which arenot shown in FIG. 5, and has a speech communication function implementedby a technology called Voice over Internet Protocol (VoIP), etc. Theworker can execute speech communication with, for example, the managervia the worker terminal 10 by the speech communication function.

The worker terminal 10 may further include, for example, an LED lamp(not shown), etc., to notify the worker of various alerts.

FIG. 6 shows an example of a system configuration of the managerterminal 30. As shown in FIG. 6, the manager terminal 30 includes a CPU31, a ROM 32, a RAM 33, a communication module 34, a display 35, etc.

The CPU 31 is a hardware processor (processing circuit) which controlsoperations of the components in the manager terminal 30. The CPU 31executes various types of software (programs for the manager terminal30) loaded from the ROM 32 which is a nonvolatile memory on the RAM(main memory) 33.

The communication module 34 is, for example, a module which executeswireless communication with the management server 40, etc.

The display 35 is a display device which displays various types ofinformation. The display 35 implies, for example, a liquid crystaldisplay (LCD).

In addition, the manager terminal 30 is assumed to include, for example,a speech communication function which enables the manager to executespeech communication with the worker, similarly to the worker terminal10, but the function is not shown in FIG. 6.

If the manager terminal 30 is the eyeglasses-type wearable terminal orthe like as explained above, the manager terminal 30 may further includevarious sensors such as a GPS sensor, an acceleration sensor and abarometric pressure sensor.

FIG. 7 is a block diagram showing a functional configuration of themanagement server 40. As shown in FIG. 7, the management server 40includes a controller 41, a communication processor 42, an informationmanagement module 43, worker information storage 44, device informationstorage 45, and process information storage 46.

In the present embodiment, some or all the controller 41, thecommunication processor 42 and the information management module 43 arerealized by causing a computer such as a CPU (hardware processor notshown) provided in the management server 40 to execute a program(program for the management server 40), i.e., by software. Some or allthe modules 41 to 43 may be implemented by hardware such as anintegrated circuit (IC), etc., or implemented as a combinedconfiguration of software and hardware. The program executed by thecomputer may be installed in, for example, an arbitrary storage device(memory) provided in the management server 40.

The controller 41 controls the operation of the management server 40.The management server 40 can manage the worker wearing the workerterminal 10 and the product manufacturing process executed by themanufacturing device 20, etc., under control of the controller 41.

The communication processor 42 executes wireless communication with theworker terminal 10, etc. The communication processor 42 receives, forexample, the above-explained position information, accelerationinformation, height information, etc., of the worker from the workerterminal 10.

The information management module 43 manages various types ofinformation stored in the worker information storage 44, the deviceinformation storage 45, and the process information storage 46.

The worker information storage 44 stores information about the workerworking within the work area 100 (hereinafter called workerinformation).

The device information storage 45 stores information about themanufacturing device 20 installed in the work area 100 (hereinaftercalled device information).

The process information storage 46 stores information about the productmanufacturing process executed by the manufacturing device 20(hereinafter called process information).

In the present embodiment, (the controller 41 provided in) themanagement server 40 estimates a status of the worker working within thework area 100, with the information received from the worker terminal10, and the information stored in the worker information storage 44, thedevice information storage 45, and the process information storage 46.For example, the manager terminal 30, etc., are notified of the workerstatus estimated by the controller 41, via, for example, thecommunication processor 42.

The worker information stored in the worker information storage 44, thedevice information stored in the device information storage 45, and theprocess information stored in the process information storage 46 shownin FIG. 7 will be explained.

FIG. 8 shows an example of a data structure of the worker informationstored in the worker information storage 44. As shown in FIG. 8, theworker information stored in the worker information storage 44 includesposition information indicating a position of a worker and the status ofthe worker in association with a worker ID to identify the worker.

In the example shown in FIG. 8, the worker information storage 44 storesworker information elements 441 to 443.

The worker information element 441 includes position information “Xu1,Yu1” and status “working” in association with worker ID “HO_0001”. Theworker information element 441 indicates that the position of the workeridentified by worker ID “HO_0001” is the position indicated by positioninformation “Xu1, Yu1” and that the worker is executing the work (i.e.,working). If the worker executes the work such as operating themanufacturing device 20, the status may include an identifier toidentify the manufacturing device 20.

The position information “Xu1, Yu1” is assumed to indicate a position ona plane (XY plane) including an X-axis and a Y-axis where apredetermined position in the work area 100 is an origin and, forexample, an axis in an East-West direction is the X-axis and an axis ina North-South direction is the Y-axis. The origin may be, for example,the position of the major manufacturing device 20 installed in the workarea 100, a corner of the work area 100, or the like. The other positioninformation may be set similarly.

The worker information element 442 includes position information “Xu2,Yu2” and status “moving” in association with worker ID “HO_0002”. Theworker information element 442 indicates that the position of the workeridentified by worker ID “HO_0002” is the position indicated by positioninformation “Xu2, Yu2” and that the worker is executing the movement(i.e., moving).

The worker information element 443 includes position information “Xu3,Yu3” and status “waiting” in association with worker ID “HO_0003”. Theworker information element 443 indicates that the position of the workeridentified by worker ID “HO_0003” is the position indicated by positioninformation “Xu3, Yu3” and that the worker is waiting.

The position information included in the worker information elements 441to 443 can be periodically updated by receiving the above-explainedworker position information from the worker terminal 10. The statusincluded in the worker information elements 441 to 443 can beperiodically updated, based on the worker position information and theabove-explained status information of the manufacturing device 20. Morespecifically, for example, if the manufacturing device 20 in closevicinity to the worker position indicated by the position information isin the status of manufacturing the product, the status can be updated to“working (for example, executing the work of operating the manufacturingdevice 20)”. The manufacturing device 20 in close vicinity to the workerposition can be identified (searched) with the position informationincluded in the device information to be explained later. If the workerposition indicated by the periodically updated position informationmoves sequentially, the status can be updated to “moving”. Furthermore,if the worker position indicated by the position information is apredetermined position (for example, a standby location), etc., thestatus can be updated to “waiting”.

The status included in the worker information may be updated inaccordance with, for example, the worker status specified by the workerat the worker terminal 10.

The worker information elements 441 to 443 alone have been explainedwith reference to FIG. 8, but the worker information storage 44 storesthe worker information about all the workers working within the workarea 100. The worker information about the worker has been explainedbut, for example, if the manager walks around in the work area 100, theposition information indicating the manager position (managerinformation about the manager) may be managed in the management server40.

FIG. 9 shows an example of a data structure of the device informationstored in the device information storage 45. As shown in FIG. 9, thedevice information stored in the device information storage 45 includesposition information indicating a position of the manufacturing device20 and the risk information associated with use of the manufacturingdevice 20 (hereinafter called a device risk) in association with adevice ID to identify the manufacturing device 20.

In the example shown in FIG. 9, the device information storage 45 storesdevice information elements 451 to 453.

The device information element 451 includes position information “Xd1,Yd1” and device risk “5” in association with device ID “M_0001”. Thedevice information element 451 indicates that the manufacturing device20 identified by device ID “M_0001” is installed at a position indicatedby position information “Xd1, Yd1” and that the device risk of themanufacturing device 20 is 5.

The device information element 452 includes position information “Xd2,Yd2” and device risk “4” in association with device ID “M_0002”. Thedevice information element 452 indicates that the manufacturing device20 identified by device ID “M_0002” is installed at a position indicatedby position information “Xd2, Yd2” and that the device risk of themanufacturing device 20 is 4.

The device information element 453 includes position information “Xd3,Yd3” and device risk “1” in association with device ID “M_0003”. Thedevice information element 453 indicates that the manufacturing device20 identified by device ID “M_0003” is installed at a position indicatedby position information “Xd3, Yd3” and that the device risk of themanufacturing device 20 is 1.

The device risk included in the device information is assumed to berepresented by, for example, numbers 1 to 5. In this case, for example,device risk “1” represents the lowest risk (i.e., safest) and devicerisk “5” represents the highest risk (i.e., most dangerous). The devicerisk is assumed to be determined by considering not only the risk in theoperation of the manufacturing device 20, etc., but also theinstallation position of the manufacturing device 20 (for example,installation at a high position).

The device information elements 451 to 453 alone have been explainedwith reference to FIG. 9, but the device information storage 45 storesthe device information about all the manufacturing devices 20 installedin the work area 100.

FIG. 10 shows an example of a data structure of the process informationstored in the process information storage 46. As shown in FIG. 10, theprocess information stored in the process information storage 46includes a manufacturing start time, a work name and a status inassociation with the device ID to identify the manufacturing device 20.

The manufacturing start time indicates a start time of the process ofmanufacturing the product by the manufacturing device 20 identified bythe device ID associated with the manufacturing start time (hereinaftercalled a manufacturing process of the manufacturing device 20). The workname indicates the work executed by the worker in the manufacturingprocess of the manufacturing device 20 identified by the device IDassociated with the work name. The status indicates the current statusof the manufacturing device 20 identified by the device ID associatedwith the status. The status is assumed to be periodically updated, basedon the status information of the manufacturing device 20 received fromeach manufacturing device 20.

In the example shown in FIG. 10, the process information storage 46stores process information elements 461 to 464.

The process information element 461 includes manufacturing start time“10:00”, work name “work A” and status “manufacturing” in associationwith device ID “M_0001”. The process information element 461 indicatesthat the start time of the manufacturing process of the manufacturingdevice 20 identified by device ID “M_0001” is 10:00, that the workexecuted by the worker in the manufacturing process is work A, and thatthe manufacturing device 20 is in a status of manufacturing the product.

The process information element 462 includes manufacturing start time“10:30”, work name “work B” and status “preparation complete” inassociation with device ID “M_0002”. The process information element 462indicates that the start time of the manufacturing process of themanufacturing device 20 identified by device ID “M_0002” is 10:30, thatthe work executed by the worker in the manufacturing process is work B,and that preparation of the manufacturing device 20 for manufacturingthe product is complete (i.e., start of the manufacturing is waited).

The process information element 463 includes manufacturing start time“11:30”, work name “work C” and status “preparation incomplete” inassociation with device ID “M_0003”. The process information element 463indicates that the start time of the manufacturing process of themanufacturing device 20 identified by device ID “M_0003” is 11:30, thatthe work executed by the worker in the manufacturing process is work C,and that the preparation of the manufacturing device 20 formanufacturing the product is incomplete.

The process information element 464 includes manufacturing start time“12:30”, work name “work D” and status “preparation incomplete” inassociation with device ID “M_0004”. The process information element 464indicates that the start time of the manufacturing process of themanufacturing device 20 identified by device ID “M_0004” is 12:30, thatthe work executed by the worker in the manufacturing process is work D,and that the preparation of the manufacturing device 20 formanufacturing the product is incomplete.

The process information elements 461 to 464 alone have been explainedwith reference to FIG. 10, but the process information storage 46 storesthe process information about all the manufacturing devices 20 installedin the work area 100.

The operation of estimating the status of the worker working within thework area 100, by the management server 40 of the present embodimentwill be hereinafter explained.

First, summary of the processing of estimating the worker status(hereinafter called status estimation processing) will be explained.

In the present embodiment, the worker status estimated by the statusestimation processing is assumed to imply, for example, “dangerous” and“safe”. “dangerous” indicates that the worker is in a dangerous status.“safe” indicates that the worker is in a safe status.

In the status estimation processing, as shown in FIG. 11, the workerstatus is estimated based at least in part on position information “Xu,Yu” of the worker, position information (Xd, Yd) of each manufacturingdevice 20 installed in the work area 100, and device risk (Rd).

More specifically, for example, if the manufacturing device 20 of highrisk is installed in close vicinity to the worker, it is estimated thatthe worker status is “dangerous”. In contrast, if the manufacturingdevice 20 is not installed in close vicinity to the worker or if therisk of the manufacturing device 20 which is installed in close vicinityto the worker is low, it is estimated that the worker status is “safe”.

Furthermore, height information (Zu) of the worker may be used as shownin FIG. 12, in the status estimation processing. Height information (Zu)of the worker indicates a position in the vertical direction of theworker, based on a floor surface (work floor) of the work area 100 asshown in, for example, FIG. 1. In this case, if the manufacturing device20 of high risk is installed in close vicinity to the worker asexplained above and if the worker is located at a high place, it isestimated that the worker status is “dangerous”. If the manufacturingdevice 20 of high risk is installed in close vicinity to the worker asexplained above, but if the worker is not located at a high place, it isestimated that the worker status is “safe”.

The summary of the status estimation processing has been explained withreference to FIG. 11 and FIG. 12, and a procedure of the statusestimation processing will be hereinafter explained in detail withreference to a flowchart of FIG. 13. In FIG. 13, the worker status isestimated based on the worker height information in addition to theworker position information, the position information of eachmanufacturing device 20 and the device risk. The processing shown inFIG. 13 is executed by the management server 40.

The processing shown in FIG. 13 is executed for each of worker terminals10 worn by the respective workers working within the work area 100, andthe worker terminal 10 which is a target of the processing is called atarget worker terminal 10 for convenience in the following explanations.Similarly, the worker wearing the target worker terminal 10 is called atarget worker for convenience.

First, the target worker terminal 10 worn by the target worker workingwithin the work area 100 periodically transmits, for example, theposition information, acceleration information and height information ofthe target worker, to the management server 40, together with the workerID to identify the target worker, by continuously driving the GPS sensor14, the acceleration sensor 15 and the barometric pressure sensor 16.

The communication processor 42 in the management server 40 therebyreceives the position information, acceleration information, and heightinformation of the target worker from the target worker terminal 10(block B1).

Each manufacturing device 20 installed in the work area 100 periodicallytransmits the status information indicating the status of themanufacturing device 20 (i.e., status information of the manufacturingdevice 20) to the management server 40. The status information of themanufacturing device 20 thus transmitted periodically from themanufacturing device 20 is also received by the communication processor42.

If the communication processor 42 receives various types of information,the information management module 43 updates (the position informationand the status included in) the worker information and (the statusincluded in) the process information, based on the position informationof the target worker, the status information of the manufacturing device20, etc.

If the processing of block B1 is executed, the controller 41 specifiesthe manufacturing device 20 installed in close vicinity to the targetworker, based on each of the position information elements included inthe device information stored in the device information storage 45(block B2).

More specifically, the controller 41 determines whether a distancebetween the position indicated by the position information (firstposition information) included in each of the device informationelements and the position indicated by the position information (secondposition information) of the target worker (i.e., a distance from thetarget worker) is smaller than or equal to a predetermined value(hereinafter called a first threshold value) or not, and specifies themanufacturing device 20 determined to have the distance smaller than orequal to the first threshold value as the manufacturing device 20installed in close vicinity to the target worker. If no manufacturingdevice 20 is installed in close vicinity to the target worker (i.e., ifthe distance from the target worker is not smaller than or equal to thefirst threshold value in any manufacturing devices 20), the targetworker is estimated to be in the safe status and the subsequentprocessing is not executed.

In the following explanations, the manufacturing device 20 specified inblock B2 (i.e., the manufacturing device installed in close vicinity tothe target worker) is called the target manufacturing device 20 forconvenience.

The controller 41 acquires the device risk included in the deviceinformation about the target manufacturing device 20 stored in thedevice information storage 45 (i.e., the device risk of the targetmanufacturing device 20) (block B3). In this case, the controller 41acquires the device risk included in the device information, inassociation with the device ID to identify the target manufacturingdevice 20.

Next, the controller 41 determines whether the device risk of the targetmanufacturing device 20 acquired in block B3 is high or not (block B4).In this case, the controller 41 determines whether the device risk ofthe target manufacturing device 20 is greater than or equal to apredetermined value (hereinafter called a second threshold value) ornot. If the device risk of the target manufacturing device 20 isdetermined to be greater than or equal to the second threshold value,the device risk of the target manufacturing device 20 is determined tobe high. If the device risk of the target manufacturing device 20 is notdetermined to be greater than or equal to the second threshold value, itis determined that the device risk of the target manufacturing device 20is not high.

If the device risk of the target manufacturing device 20 is determinedto be high (YES in block B4), it is determined whether the target workeris located at a high position or not, based on the height information ofthe target worker (block B5). In this case, the controller 41 determineswhether the position (height) in the vertical direction of the targetworker indicated by the height information of the target worker ishigher than a threshold position (height) or not. If the position in thevertical direction of the target worker is determined to be higher thanthe threshold position, the target worker is determined to be located ata high position. In contrast, if the position in the vertical directionof the target worker is not determined to be higher than the thresholdposition, it is determined that the target worker is not located at ahigh position.

It can be estimated whether, for example, the target worker is executingthe work (i.e., working) or not, based on (variation in) theacceleration indicated by the acceleration information of the targetworker received in block B1.

For this reason, if the target worker is determined to be located at ahigh position (YES in block B5), the controller 41 determines whetherthe target worker is working or not, based on the acceleration indicatedby the acceleration information of the target worker received in blockB1 (block B6).

If the target worker is determined to be working (YES in block B6), thecontroller 41 estimates that the target worker is associated with adangerous status. In other words, the controller 41 estimates that thetarget worker is in the dangerous status (i.e., the target worker isworking in the dangerous status) (block B7). In this case, “dangerous”is held in the management server 40 as the target worker status.

If it is determined in block B4 that the device risk of the targetmanufacturing device 20 is not high (NO in block B4), it is estimatedthat the target worker is not in the dangerous status (i.e., the workeris in the safe status), and the processing is ended. In this case,“safe” is held in the management server 40 as the target worker status.“safe” is also stored in a case where it is determined that the targetworker is not located at a high position in block B5 (NO in block B5) orit is determined that the target worker is not working in block B6 (NOin block B6).

Each status (“dangerous” or “safe”) of the worker working within thework area 100 can be managed in the management server 40 by executingthe processing shown in FIG. 13 for each worker terminal 10. Theprocessing shown in FIG. 13 is periodically executed every time themanagement server 40 receives the position information, accelerationinformation, height information of each worker as explained above. Thestatus of each worker is thereby updated in accordance with thevariation in status.

In the processing shown in FIG. 13, the target worker is estimated to bein the dangerous status in a case where the device risk of the targetmanufacturing device 20 is high, the target worker is located at a highposition, and the target worker is working, but one or two types of theprocessing in, for example, blocks B4 to B6 may be omitted. In otherwords, if the target worker is located at a high position and the targetworker is working in a case where, for example, the processing in blockB4 is omitted, the target worker may be estimated to be in the dangerousstatus. In addition, if the device risk of the target manufacturingdevice 20 is high and the target worker is working in a case where, forexample, the processing in block B5 is omitted, the target worker may beestimated to be in the dangerous status. Furthermore, if the device riskof the target manufacturing device 20 (i.e., the manufacturing device inclose vicinity to the target worker) is high in a case where, forexample, the processing in blocks B5 and B6 is omitted, the targetworker may be estimated to be in the dangerous status.

The processing in block B6 may be executed on the worker terminal 10side. In this case, it may be determined by the worker terminal 10whether the target worker is working or not, based on the accelerationindicated by the acceleration information of the target worker, and thedetermination result may be transmitted from the worker terminal 10 tothe management server 40 instead of the acceleration information.

Furthermore, for example, if the worker terminal 10 is able to acquirethe device information, etc., all the processing shown in FIG. 13 may beexecuted on the worker terminal 10 and the estimation result of theworker status may be output to the management server 40, etc.

It is determined whether the target worker is working or not, based onthe acceleration indicated by the acceleration information of the targetworker but, in some cases, the acceleration does not occur on the workerterminal 10 (eyeglasses-type wearable terminal) in accordance with thework (content) and it often cannot be detected that the target worker isworking. For this reason, it may be determined in block B6 whether thetarget worker is working or not, based on, for example, the information(worker information and process information) stored in the workerinformation storage 44 or the process information storage 46. Morespecifically, for example, if the status included in the workerinformation in association with the worker ID to identify the targetworker indicates that the target worker is working, it may be determinedthat the target worker is working. In addition, for example, if thestatus included in the process information in association with thedevice ID to identify the target manufacturing device 20 indicates thatthe manufacturing device is manufacturing (i.e., the targetmanufacturing device 20 is being operated), it may be determined thatthe target worker is working. It may be determined whether the targetworker is working or not, based on the acceleration information, workerinformation and process information of the target worker.

In the present embodiment, for example, the worker terminal 10 worn bythe worker estimated to be “dangerous” (i.e., the worker in thedangerous status) and the manager terminal 30 are assumed to receive anoutput of a notification corresponding to the status.

A processing procedure of the management server 40, of outputting thenotification to the worker terminal 10 and the manager terminal 30 willbe hereinafter explained with reference to a flowchart of FIG. 14.

First, the manager can execute, for example, instructions of workassignment, confirmation and change of work contents, etc., for eachworker, by speech communication (telephone), by using (the speechcommunication function of) the worker terminal 10 and the managerterminal 30. In this case, the manager executes an operation for anoutgoing call to (the worker terminal 10 worn by) the worker who is thetarget of instruction (hereinafter called an outgoing call operation),on the manager terminal 30. The outgoing call operation implies, forexample, an operation of displaying a screen for making the outgoingcall to the worker on the manager terminal 30, an operation of pressinga button to make the outgoing call to the worker on the screen, etc. Theworker who the manager is to make the outgoing call by the outgoing calloperation is hereinafter called a target worker in the explanations ofFIG. 14.

If the outgoing call operation is executed on the manager terminal 30,the manager terminal 30 transmits an inquiry to the management server40. The inquiry includes the worker ID to identify the target worker.

The communication processor 42 in the management server 40 receives theinquiry transmitted by the manager terminal 30 (block B11).

Next, the controller 41 determines whether the status of the targetworker identified by the worker ID included in the inquiry received inblock B11 is “dangerous” or not, based on each status of the workermanaged by the management server 40 by executing the processing shown inFIG. 13 (block B12).

If the status of the target worker is determined to be “dangerous” (YESin block B12), the controller 41 outputs a notification includinginformation that the status of the target worker is “dangerous” to themanager terminal 30, as a response to the inquiry received in block B11(block B13).

In this case, the notification output by the controller 41 is displayedon the display 35 of the manager terminal 30. More specifically, forexample, a message or the like indicating that the outgoing call to thetarget worker should not be made (or the target worker cannot respond tothe incoming call) since the status of the target worker is “dangerous”,is displayed on the display 35 of the manager terminal 30.

If such a message is displayed on the display 35 of the manager terminal30, it is preferable that the manager cancel the outgoing call to thetarget worker and execute the outgoing call operation again after, forexample, a predetermined time has elapsed.

As explained above, if the processing in block B13 is executed, theoutgoing call made by the manager is canceled, and the controller 31outputs to the worker terminal 10 a notification including informationthat the outgoing call has been canceled but the outgoing call operationhas been executed by the manager (i.e., the outgoing call operation hasbeen executed at the manager terminal 30) (block B14).

In this case, the notification output by the controller 41 is displayedon the display (lens-integrated screen 1002) of the worker terminal 10.More specifically, a message, a mark or the like indicating that theoutgoing call operation has been executed by the manager (i.e., themanger has been willing to make the outgoing call to the target worker)is displayed on the display of the worker terminal 10. The message, themark or the like is displayed in an area 1100, etc., of thelens-integrated screen 1002 as shown in FIG. 15 in order to secure thesight of the target worker wearing the worker terminal 10. The area 1100shown in FIG. 15 is arranged at an upper portion of the lens-integratedscreen 1002, but may be located at the other position (for example, alower portion or the like) of the lens-integrated screen 1002 if thesight of the target worker can be secured.

The worker may be notified of the information that the outgoing calloperation has been executed by the manager, by turning on the LED lampmounted at the worker terminal 10, etc.

In the present embodiment, if an incoming call has come from the managerwhile the status of the target worker is “dangerous”, cancellation ofthe outgoing call made by the manager is promoted, from the viewpointthat, for example, the target worker willing to respond to the incomingcall may be involved in an unexpected accident. In contrast, even if themessage or the like is displayed on the display of the worker terminal10 while the status of the target worker is “dangerous”, the targetworker willing to confirm the message may be involved in an unexpectedaccident. For this reason, for example, such a message or the like maybe displayed after the status of the target worker is updated from“dangerous” to “safe” (i.e., the dangerous status of the target workerhas been eliminated).

In the present embodiment, if the status of the target worker is“dangerous”, cancellation of the outgoing call made by the manager ispromoted but, conversely, the manager may make the outgoing call to thetarget worker. In this case, in order to prevent risk (maintainsecurity) on the target worker, the worker terminal 10 may be set not tooutput a ringing tone (incoming tone) (i.e., set not to ring) when theoutgoing call is made by the manager. In such a configuration, since thetarget worker often does not recognize the incoming call, an incomingcall history at the worker terminal 10 may be displayed on the displayof the worker terminal 10 when, for example, the status of the targetworker is updated from “dangerous” to “safe”.

Furthermore, if the status of the target worker is “dangerous”, anincoming call may be forcefully rejected at the worker terminal 10 wornby the target worker under control of, for example, the managementserver 40.

In the processing shown in FIG. 14, the notification including theinformation that the outgoing call operation has been executed by themanager is output to the worker terminal 10 (i.e., the worker isnotified that the outgoing call operation has been executed by themanager) but, for example, the worker may be notified that the worker isin a dangerous status. In this case, for example, the worker can benotified of information that the device risk of the manufacturing device20 in close vicinity to the worker is high, or the like.

In addition, for example, if it is determined that the worker is moving,based on the worker position information periodically transmitted fromthe worker terminal 10 and if a dangerous street or site is located inclose vicinity to the worker, the worker may be notified of presence ofthe dangerous street or site, etc. Furthermore, if a vehicle for work istraveling in the work area 100, the worker may be notified ofinformation that the vehicle is approaching the worker, based on aposition of the vehicle which is detected by a GPS sensor mounted in thevehicle. In this case, the worker may also be notified of theinformation together with a distance between the worker and the vehicle,etc.

Moreover, the worker may be notified of, for example, the status of themanufacturing device in close vicinity to the worker (for example, themanufacturing device is undergoing a trial run or out of action) inaddition to the information that the worker is in the dangerous status.

In the present embodiment, as explained above, the position information(second position information) indicating the position of the worker(user) working within the work area 100 while wearing the workerterminal (eyeglasses-type wearable terminal) 10 is received from theworker terminal 10, and the worker status is estimated based on theposition information (first position information) and the riskinformation included in the device information stored in the deviceinformation storage 45, and the received position information.

More specifically, for example, if the device risk of the manufacturingdevice 20 in close vicinity to (the worker wearing) the worker terminal10 is greater than or equal to the predetermined value (second thresholdvalue), it can be estimated that the worker in the dangerous status.

The position information received from the worker terminal 10 in thiscase is assumed to indicate the position detected by the GPS sensor 14mounted in the worker terminal 10. The position of (the worker terminal10 worn by) the worker may be estimated based on, for example, theposition of the access point or the like which can establishcommunication with the worker terminal 10, of a plurality of accesspoints provided in the work area 100.

In the present embodiment having such a configuration, since the managerdoes not need to confirm, for example, the status of each worker, burdenon the manager can be reduced.

In addition, in the present embodiment, if it is further determined thatthe worker is located at a high position (i.e., the position in thevertical direction of the worker is higher than the threshold position),it can also be estimated that the worker is in the dangerous status. Ifit is further determined that the worker is working, it can also beestimated that the worker is in the dangerous status. In such aconfiguration, the worker status (i.e., the worker's dangerous status)can be estimated more exactly.

The position in the vertical direction of the worker is estimated basedat least in part on (the variation in) the barometric pressure measuredby the barometric pressure sensor 16 mounted in the worker terminal 10,but may be estimated based at least in part on, for example, an imageshowing the worker as taken by a camera provided in the work area 100 oran image showing the worker's periphery as taken by the camera 1003mounted in the worker terminal 10. In addition, whether the worker isworking or not may be determined based at least in part on theacceleration measured by the acceleration sensor 15 mounted in theworker terminal 10 or on the position information of the manufacturingdevice 20 included in the device information, the worker positioninformation received from the worker terminal 10, the status informationreceived from the manufacturing device 20, etc.

Furthermore, in the present embodiment, if the operation for outgoingcall to the worker (i.e., the outgoing call operation) is executed forthe manager terminal 30, the notification including the information thatthe worker is in the dangerous status is output to the manager terminal30. In the present embodiment having such a configuration, since themanager can cancel the outgoing call to the worker in the dangerousstatus, the worker can concentrate on the (dangerous) work withoutattending to an incoming call or the like corresponding to the outgoingcall from the manager. According to this, security of the worker can besecured, and the work efficiency of the worker, the manufacturingefficiency of the manufacturing device 20, etc., can be enhanced. Thenotification including the information that the worker is in thedangerous status may be output to the manager terminal 30 when, forexample, the worker is estimated to be in the dangerous status.

In the present embodiment, (the worker terminal 10 worn by) the workeris notified of the information that the outgoing call operation has beenmade to the manager terminal 30 (i.e., the manager has been willing tomake the outgoing call). In such a configuration, for example, since theworker can make an outgoing call to (i.e., call) the manager afterending a dangerous work, the manager can efficiently give an instructionto (i.e., establish communication with) the worker.

In the present embodiment, the worker can execute the work in ahands-free style by using the eyeglasses-type wearable terminal as theworker terminal 10. The worker terminal 10 of the present embodimentneeds only to have an ability to supply (transmit) the positioninformation, acceleration information and height information of theworker to the management server 40, and may be a wearable device in theother shapes such as a wristband. Furthermore, the worker terminal 10may be a mobile device such as a smartphone held by the worker.

If the worker wearing the worker terminal (eyeglasses-type wearableterminal) 10 holds a mobile device such as a smartphone, for example,the worker terminal 10 and the smartphone can also be configured to linkwith each other. More specifically, the worker terminal 10 and thesmartphone may be connected by, for example, Bluetooth (registeredtrademark) so as to establish communication with each other, and theposition information indicating the position detected by the GPS sensormounted in the smartphone may be received from the smartphone and usedby the worker terminal 10.

An image taken by a camera mounted in the smartphone may be transmittedto the worker terminal 10 and displayed on the display of the workerterminal 10.

Furthermore, the worker status such as movement may be detected by afunction incorporated in the smartphone to measure the number of stepsof the worker, and the detected status may be transmitted to themanagement server 40.

If the worker terminal 10 does not include a speech communicationfunction, speech communication between the worker and the manager may beestablished by using the speech communication function incorporated inthe smartphone.

If the worker terminal 10 and the smartphone are thus linked with eachother, various functions of the smartphone can be used.

Second Embodiment

Next, a second embodiment will be described. Since the environment inwhich a management system of the present embodiment is used, the networkconfiguration of the management system, configurations of the workerterminal, manager terminal and management server, etc., are the same asthose of the first embodiment, they are not hereinafter explained indetail. Arbitrarily, the present embodiment will be explainedhereinafter with reference to FIG. 1 to FIG. 7. In the presentembodiment, portions different from the first embodiment will be mainlyexplained.

The present embodiment is different from the first embodiment withrespect to a data structure of device information stored in a deviceinformation storage 45 incorporated in a management server 40.

FIG. 16 shows an example of the data structure of the device informationstored in the device information storage 45 of the present embodiment.As shown in FIG. 16, the device information stored in the deviceinformation storage 45 includes position information, device risk, workname and work risk in association with a device ID. The device ID, theposition information and the device risk have been explained withreference to FIG. 9, and their detailed explanations are omitted.

The work name indicates a work executed by a worker in a manufacturingprocess of a manufacturing device 20 identified by the device IDassociated with the work name. The work name included in the deviceinformation indicates a work obtained by further dividing the workrepresented by the work name included in the process information shownin FIG. 10. For this reason, a plurality of work names are associatedwith one device ID, in the device information shown in FIG. 16.

The work risk includes risk information (second risk information)associated with work executed in the particular range. In other words,the work risk indicates a risk about the work (content) represented bythe work name associated with the work risk.

In the example shown in FIG. 16, the device information storage 45stores device information elements 451 a, 452 a and 453 a. Deviceinformation element 451 a is information about the manufacturing device20 identified by device ID “M_0001”. Device information element 452 a isinformation about the manufacturing device 20 identified by device ID“M_0002”. Device information element 453 a is information about themanufacturing device 20 identified by device ID “M_0003”.

The device information element 451 a includes work names “work A1”,“work A2” and “work A3” in association with device ID “M_0001”. The workindicated by each of work names “work A1” to “work A3” corresponds toeach of the works obtained by dividing the work A executed by the workerin the manufacturing process of the manufacturing device 20 identifiedby device ID “M_0001” as explained with reference to FIG. 10. The deviceinformation element 451 a includes work risks “1”, “3” and “5” inassociation with work names “work A1”, “work A2” and “work A3”,respectively. According to the device information element 451 a, therisk about the work indicated by work name “work A1” is 1, the riskabout the work indicated by work name “work A2” is 3, and the risk aboutthe work indicated by work name “work A3” is 5.

The device information element 452 a includes work names “work B1” and“work B2” in association with device ID “M_0002”. The work indicated byeach of work names “work B1” and “work B2” corresponds to each of theworks obtained by dividing the work B executed by the worker in themanufacturing process of the manufacturing device 20 identified bydevice ID “M_0002” as explained with reference to FIG. 10. The deviceinformation element 452 a includes work risks “2” and “4” in associationwith work names “work B1” and “work B2”, respectively. According to thedevice information element 452 a, the risk about the work indicated bywork name “work B1” is 2 and the risk about the work indicated by workname “work B2” is 4.

The device information element 453 a includes work name “work C1” inassociation with device ID “M_0003”. The work C executed by the workerin the manufacturing process of the manufacturing device 20 identifiedby device ID “M_0003” as explained with reference to FIG. 10 cannot bedivided. For this reason, one work name alone is associated with deviceID “M_0003” in the device information element 453 a. In the case, workname “work C” included in the process information 463 shown in FIG. 10and work name “work C1” included in the device information element 453 aindicate the same work. The device information element 453 a includeswork risk “1” in association with work name “work C1”. The deviceinformation element 453 a indicates that the risk about the workrepresented by work name “work C1” is 1.

In the present embodiment, the worker status (“dangerous” or “safe”) isestimated with the work risk.

Next, a procedure of the status estimation processing of the presentembodiment will be explained with reference to a flowchart shown in FIG.17.

First, processing of blocks B21 to B26 corresponding to the processingof blocks B1 to B6 shown in FIG. 13 is executed.

It is determined in block B26 whether the target worker is working ornot, based on (the variation in) the acceleration indicated by theacceleration information of the target worker received in block B21 but,in some cases, specific vibration (acceleration) occurs on the targetworker at a specific work and (a type of) the work (content) that thetarget worker is executing can be specified (estimated) based at leastin part on the acceleration. The (pattern of) acceleration occurring ateach work is preliminarily held in the management server 40.

For this reason, if it is determined in block B26 that the target workeris working (YES in block B26), the controller 41 acquires the work riskincluded in the device information (work risk of the targetmanufacturing device 20) in association with the work name indicatingthe work specified as explained above (block B27).

Next, the controller 41 determines whether the work risk of the targetmanufacturing device 20 acquired in block B27 is high or not (blockB28). In this case, the controller 41 determines whether the work riskof the target manufacturing device 20 is greater than or equal to athreshold value (hereinafter called a third threshold value) or not. Ifthe device risk of the target manufacturing device 20 is determined tobe greater than or equal to the third threshold value, the work risk ofthe target manufacturing device 20 is determined to be high. If it isdetermined that the work risk of the target manufacturing device 20 isnot greater than or equal to the third threshold value, it is determinedthat the work risk of the target manufacturing device 20 is not high.

If the work risk of the target manufacturing device 20 is determined tobe high (YES in block B28), the processing of the block B29corresponding to the processing of block B7 shown in FIG. 13 isexecuted.

If it is determined in block B28 that the work risk of the targetmanufacturing device 20 is not high (NO in block B28), it is estimatedthat the target worker is not in the dangerous status (i.e., the workeris in the safe status), and the processing is ended.

In the processing shown in FIG. 17, it is estimated that the targetworker is in the dangerous status if the manufacturing device 20 of highrisk is installed in close vicinity to the target worker and if thetarget worker is executing a dangerous work at a high position. Itshould be noted that at least one processing of blocks B24 to B26 andB28 may be omitted. If the processing of block B28 is omitted, theprocessing of block B27 is also omitted.

In the processing of block B27, the work (content) which the targetworker is executing may be estimated based on, for example, theinformation (worker information or process information) stored in theworker information storage 44 or the process information storage 46.More specifically, if the status included in the worker informationabout the target worker is “working” and, for example, if the statusincluded in the process information in association with the device ID toidentify the target manufacturing device 20 is “manufacturing”, it canbe specified (estimated) that the work indicated by the work nameincluded in the process information is the work which the target workeris executing.

In addition, if the status information received from the targetmanufacturing device 20 includes the operation (content) executed forthe target manufacturing device 20, the work content of the targetworker can be specified based on the operation, etc., in some cases. Forthis reason, each manufacturing device 20 may transmit the statusinformation including the operation executed for the targetmanufacturing device 20 to the management server 40. Each manufacturingdevice 20 may also transmit to the management server 40 the statusinformation including the name of the work estimated to be currentlyexecuted in accordance with the operation executed for the targetmanufacturing device 20 and the operation status of the manufacturingdevice 20, etc.

If the manager executes the outgoing call operation for the worker atthe manager terminal 30 after the status of each worker is estimated byexecuting the processing shown in FIG. 17, the processing explained withreference to FIG. 14 is executed, but detailed explanations of thisprocess are omitted in the present embodiment.

In the present embodiment, as explained above, the worker is estimatedto be in the dangerous status if the risk about the work which theworker is executing is further determined to be greater than or equal tothe predetermined value (third threshold value), as compared with thefirst embodiment.

For example, even if the worker is working in close vicinity to themanufacturing device 20 of high device risk (i.e., working for themanufacturing device 20), the risk about the current work may not behigh according to progress of the manufacturing process of themanufacturing device 20.

In the present embodiment, possibility to urge the manager to cancel theoutgoing call (i.e., to urge the manager not to call) though the riskabout the work executed by the worker is not high (i.e., the worker isin a status of being able to response to the incoming call) can beavoided by utilizing the work risk as explained above. The manager canthereby give an instruction to (establish communication with) the workermore smoothly, as compared with the first embodiment.

Third Embodiment

Next, a third embodiment will be described. The present embodiment isdifferent from the second embodiment with respect to a feature that aworker terminal 10 serving as an eyeglasses-type wearable terminalincludes a line-of-sight detection sensor 18 as shown in FIG. 18.

The line-of-sight detection sensor 18 is, for example, a sensor using aneye potential sensing technology, and measures a potential difference(voltage variation) generated between a cornea side and a retina side ofan eyeball, which is varied by the movement of the eyeball, with aplurality of electrodes attached to the worker terminal 10 (a peripheryof the eye).

The worker terminal 10 can obtain the number of times of blink, theangle (direction) of the line of sight, etc., of the worker, based onthe potential differential measured by the line-of-sight detectionsensor 18, by using the line-of-sight detection sensor 18.

The information including the number of times of blink, the angle of theline of sight, etc., obtained by the worker terminal 10 (hereinaftercalled line-of-sight information) is transmitted to a management server40 via a communication module 17 together with the other information(position information, acceleration information and height information).

In the present embodiment, a worker status (“dangerous” or “safe”) isestimated with the line-of-sight information.

Next, a procedure of the status estimation processing of the presentembodiment will be explained with reference to a flowchart shown in FIG.19.

First, a communication processor 42 in the management server 40 receivesthe position information, acceleration information, height informationand line-of-sight information of a target worker from the target workerterminal 10 (block B31). The line-of-sight information received by thecommunication processor 42 includes the number of times of blink and theangle of the line of sight, of the target worker, as explained above.

Next, processing of blocks B32 to B38 corresponding to the processing ofblocks B22 to B28 shown in FIG. 17 is executed.

If the target worker is in a dangerous status (or feels dangerous), thetarget worker is often in a stressed status. In addition, a person in astressed status generally tends to increase the number of times ofblink. For this reason, in the present embodiment, the line-of-sightinformation received in block B31 is used to determine whether thetarget worker is in a stressed status or not.

If it is determined in block B38 that the work risk of the targetmanufacturing device 20 is high (YES in block B38), a controller 41determines whether the target worker is in a stressed status or not,based on the line-of-sight information received in block B31 (blockB39). In this case, the controller 41 determines whether the number oftimes of blink of the target worker included in the line-of-sightinformation is greater than or equal to a predetermined value(hereinafter called a fourth threshold value) or not. If the number oftimes of blink of the target worker is determined to be greater than orequal to the fourth threshold value, the target worker is determined tobe in a stressed status. If it is determined that the number of times ofblink of the target worker is not greater than or equal to the fourththreshold value, it is determined that the target worker is not in astressed status.

The fourth threshold value is assumed to be, for example, a valuedetermined based on the number of times of blink of the target worker ata normal time and to be preliminarily held in the management server 40.

The movement (variation in angle) of the line of sight is oftencharacteristic in a person in a stressed status. For this reason, theprocessing may be executed by considering the angle of the line of sightincluded in the line-of-sight information received in block B31, inblock B39.

If the target worker is determined to be in a stressed status (YES inblock B39), the processing of block B40 corresponding to the processingof block B29 shown in FIG. 17 is executed.

If it is determined that the target worker is not in a stressed status(NO in block B39), it is estimated that the target worker is not in thedangerous status (i.e., the worker is in the safe status), and theprocessing is ended.

In the processing shown in FIG. 19, it is estimated that the targetworker is in the dangerous status if the manufacturing device 20 of highrisk is installed in close vicinity to the target worker, if the targetworker is executing a dangerous work at a high position, and if thetarget worker is in a stressed status. It should be noted that at leastone processing of blocks B34 to B36, B38 and B39 may be omitted.

If the manager executes the outgoing call operation for the worker atthe manager terminal 30 after the status of each worker is estimated byexecuting the processing shown in FIG. 19, the processing explained withreference to FIG. 19 is executed, but detailed explanations of thisprocess are omitted in the present embodiment.

In the present embodiment, as explained above, the worker is estimatedto be in the dangerous status if the number of times of blink of thetarget worker is further determined to be greater than or equal to apredetermined value (fourth threshold value), as compared with thesecond embodiment.

In the present embodiment, in such a configuration, unnecessarycancellation of the outgoing call from the manager to the worker can besuppressed since, for example, the worker is estimated to be in thedangerous status only when the worker is in a stress status or cannotrespond to an incoming call corresponding to the outgoing call made bythe manager or (it is estimated that) the worker may be involved in anaccident or the like by responding to an incoming call.

In the present embodiment, the line-of-sight detection sensor 18 is asensor employing the eye potential sensing technology (i.e., the eyepotential sensor), but any other sensors capable of obtaining the numberof times of blink, the angle of the line of sight, etc., of the workermay be used as the line-of-sight detection sensor 18. More specifically,for example, a camera (such as an infrared camera or a visible lightcamera) capable of photographing an eyeball movement of the worker maybe used as the line-of-sight detection sensor 18.

In addition, the line-of-sight information (the number of times ofblink, the angle of the line of sight, etc.) obtained by using theline-of-sight detection sensor 18 may be used to operate the workerterminal 10. In other words, the worker terminal 10 may be able to beoperated by the number of times of blink, the angle (direction) of theline of sight, etc., of the worker.

According to at least one of the above-explained embodiments, anelectronic apparatus and a method capable of estimating the status ofthe worker (user) working within a particular range can be provided.

While certain embodiments have been described, these embodiments havebeen presented by way of example only, and are not intended to limit thescope of the inventions. Indeed, the novel embodiments described hereinmay be embodied in a variety of other forms; furthermore, variousomissions, substitutions and changes in the form of the embodimentsdescribed herein may be made without departing from the spirit of theinventions. The accompanying claims and their equivalents are intendedto cover such forms or modifications as would fall within the scope andspirit of the inventions.

What is claimed is:
 1. A wearable terminal configured to be attached to an additional image display to display an additional image and configured to be attached to a prescribed sensor, the wearable terminal comprising: a lens to form a virtual image of the additional image; and an adjusting mechanism, wherein the wearable terminal is configured to be worn by a user, divergent light corresponding to the additional image passes through the lens, the lens keeps the divergent light divergent to form the virtual image, the virtual image is adjustable via a first change by the adjusting mechanism while the user sees the virtual image, the virtual image performs a second change based on information regarding behavior of the user to change a status of the user, a mobile device includes the prescribed sensor, the mobile device infers the behavior of the user based on the prescribed sensor to generate the information so that the behavior to change the status of the user is detected by a function incorporated in the mobile device, and the virtual image after the second change is formed in a prescribed area based on a result of the first change.
 2. The wearable terminal according to claim 1, wherein the adjusting mechanism is utilized to change an angle of projection of the light to adjust a position of the virtual image.
 3. A method executed by a wearable terminal which is wearable by a user and which comprises a lens and adjusting mechanism, the method comprising: displaying an additional image on an additional image display configured to be attached to the wearable terminal; and forming a virtual image of the additional image with the lens, wherein divergent light corresponding to the additional image passes through the lens, the lens keeps the divergent light divergent to form the virtual image, the virtual image is adjustable via a first change by the adjusting mechanism while the user sees the virtual image, the virtual image performs a second change based on information regarding user's behavior to change a status of the user, a mobile device includes a prescribed sensor configured to be attached to the wearable terminal, the mobile device infers the behavior of the user based on the prescribed sensor to generate the information so that the behavior to change the status of the user is detected by a function incorporated in the mobile device, and the virtual image after the second change is formed in a prescribed area based on a result of the first change.
 4. The method according to claim 3, wherein the adjusting mechanism is utilized to change an angle of projection of the light to adjust a position of the virtual image.
 5. A wearable terminal wearable by a user and which is configured to be attached to an additional image display to display an additional image and is configured to be attached to a prescribed sensor, comprising: a processor configured to determine a status change of the user based on a detecting signal obtained from the prescribed sensor; a lens configured to form a virtual image of the additional image; and an adjusting mechanism, wherein divergent light corresponding to the additional image passes through the lens, the lens keeps the divergent light divergent to form the virtual image, the virtual image is adjustable via a first change by the adjusting mechanism while the user sees the virtual image, a mobile device includes the prescribed sensor, the status change of the user is detected by a function incorporated in the mobile device, the virtual image performs a second change based on the determined status change, and the virtual image relating to the determined status change is formed in a prescribed area based on a result of the first change.
 6. A method executed by a wearable terminal which is wearable by a user and which is configured to be attached to an additional image display to display an additional image and is configured to be attached to a prescribed sensor, the method comprising: determining a status change of the user based on a detecting signal obtained from the prescribed sensor; displaying the additional image; and forming a virtual image of the additional image with a lens included in the wearable terminal, wherein divergent light corresponding to the additional image passes through the lens, the lens keeps the divergent light divergent to form the virtual image, the virtual image is adjustable via a first change by adjusting mechanism located at a predetermined position of the wearable terminal while the user sees the virtual image, a mobile device includes the prescribed sensor, the status change of the user is detected by a function incorporated in the mobile device, the virtual image performs a second change based on the determined status change, and the virtual image relating to the determined status change is formed in a prescribed area based on result of the first change.
 7. A system comprising: a server; a wearable terminal containing a lens and adjusting mechanism, the wearable terminal being configured to be attached to an additional image display to display an additional image; and a prescribed sensor configured to obtain information on a user wearing the wearable terminal, wherein the server determines a status change of the user based on the information, divergent light corresponding to the additional image passes through the lens, the lens keeps the divergent light divergent to form a virtual image of the additional image, the virtual image is adjustable via a first change by the adjusting mechanism while the user sees the virtual image, a mobile device includes the prescribed sensor, the status change of the user is detected by a function incorporated in the mobile device, the virtual image performs a second change based on the determined status change of the user, and the virtual image relating to the determined status change of the user is formed in a prescribed area based on a result of the first change.
 8. The system according to claim 7, wherein the adjusting mechanism is utilized to change an angle of projection of the light to adjust a position of the virtual image. 